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Abstract 

We consider a new hierarchy of semidefinite relaxations for the general polynomial op¬ 
timization problem (P) : /* = min{ /(x) : x G K} on a compact basic semi-algebraic set 
K C R". This hierarchy combines some advantages of the standard LP-relaxations associ¬ 
ated with Krivine’s positivity certificate and some advantages of the standard SOS-hierarchy. 
In particular it has the following attractive features: (a) In contrast to the standard SOS- 
hierarchy, for each relaxation in the hierarchy, the size of the matrix associated with the 
semidefinite constraint is the same and fixed in advance by the user, (b) In contrast to the 
LP-hierarchy, finite convergence occurs at the first step of the hierarchy for an important 
class of convex problems. Finally (c) some important techniques related to the use of point 
evaluations for declaring a polynomial to be zero and to the use of rank-one matrices make 
an efficient implementation possible. Preliminary results on a sample of non convex problems 
are encouraging. 


1 Introduction 

We consider the polynomial optimization problem: 

(P) : f* = min {/(x) : x G K } (I) 

X 

where / G M[x] is a polynomial and K C M” is the basic semi-algebraic set 

K = {x G M” : 5j(x) > 0, j = I,...,m}, (2) 

for some polynomials gj G M[x], j = 1,... ,m. In order to approximate (and sometimes solve 
exactly) (P) one may instead solve a hierarchy of convex relaxations of (P) of increasing sizes, 
namely for instance: 

• Semidefinite relaxations based on Putinar’s certificate of positivity on K |24] . where the 
d-th convex relaxation of the hierarchy is a semidefinite program given by 
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The unknowns aj are sums of squares (SOS) polynomials with the degree bound constraint, 
degree{ajgj) < 2d, j = 0,... ,m, and the expression in ([3]) is a certificate of positivity on K for 
the polynomial x ^ f{x) — t. 


• LP-relaxations based on Krivine-Stengle’s certificate of positivity on K [151127] . where the 
d-th convex relaxation of the hierarchy is a linear program given by 


0d 


max < t f — t 
A>0,i I 


m 

n (5? (1 

(a,/3)GN2"* i=l 


(4) 


where = {(a, /3) G : Ylj + Pj ^ d}- The unknown are t and the nonnegative scalars 
A = (Xajs), and it is assumed that 0 < gfj < 1 on K (possibly after scaling) and the family 
generates the algebra M[x] of polynomials. Problem (j3|) is an LP because stating that the two 
polynomials in both sides of “=” are equal yields linear constraints on the Aq^’s. For instance, 
the LP-hierarchy from Sherali-Adams RLT |25] and their variants |26] are of this form. 

In both cases, ( 7 ^) and (0^), d G N, provide two monotone nondecreasing sequences of lower 
bounds on /* and if K is compact, then both converge to /* as one lets d increases. For more 
details as well as a comparison of such relaxations, the reader is referred to e.g. Lasserre HEd 
and Laurent m. as well as Chlamtac and Tulsiani [7j for the impact of LP- and SOS-hierarchies 
on approximation algorithms in combinatorial optimization. 

Of course, in principle, one would much prefer to solve LP-relaxations rather than semidefi- 
nite relaxations (i.e. compute 9^ rather than 7 ^) because present LP-software packages can solve 
sparse problems with millions of variables and constraints, which is far from being the case for 
today’s semidefinite solvers. And so the hierarchy ([3|) applies to problems of modest size only 
unless some sparsity or symmetry is taken into account in which case specialized variants can 
handle problems of much larger size; see e.g. Waki et al. |30] . However, on the other hand, the 
LP-relaxations (j4]) suffer from several serious theoretical and practical drawbacks. For instance, 
it has been shown in dCiil that the LP-relaxations cannot be exact for most convex problems, 
i.e., the sequence of the associated optimal values converges to the global optimum only asymp¬ 
totically and not in finitely many steps. Moreover, the LPs of the hierarchy are numerically 
ill-conditioned. This is in contrast with the semidefinite relaxations m for which finite con¬ 
vergence takes place for convex problems where V^/(x*) is positive dehnite at every minimizer 
X* G K (see de Klerk and Laurent u Corollary 3.3]) and occurs at the first relaxation for 
SOS-convesEl problems |191 Theorem 3.3]. In fact, as demonstrated in recent works of Marshall 
|22j and Nie |23j . finite convergence is generic even for non convex problems. 


1.1 Contribution 

This paper is in the vein of recent attempts in Lasserre |18j and Ahmadi and Majumdar [I] 
to overcome the important computational burden associated with the standard SOS-hierarchy 
([ 3 ]) . In particular, in m we have suggested another hierarchy of convex relaxations which 
combines some of the advantages of the SOS- and LP- hierarchies dSj) and Q. In the present 
paper we take advantage of attractive features of the SDPT3 solver [28l|29] to provide an effective 
implementation of this new hierarchy. First preliminary tests on a sample of non convex problems 
are encouraging and suggest that this new hierarchy might be efficient. This new hierarchy is 
another type of SOS-hierarchy labelled BSOS (for hierarchy with bounded degree SOS) with the 
following attractive features: 

^An SOS-convex polynomial is a convex polynomial whose Hessian factors as L{x)L{x)^ for some rectangular 
matrix polynomial L. For instance, separable convex polynomials are SOS-convex. 
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• In contrast to the standard SOS-hierarchy ([3]), for each semidefinite program in the hierar¬ 
chy, the size of the semidefinite matrix variable is now fixed, parametrized by an integer 

k that one fixes in advance. This integer k determines the degree of a certain SOS polynomial 
(for instance one may fix /c = 2), whence the label BSOS (for “bounded”-SOS). Recall that in 
the standard SOS-hierarchy Q the size of the semidefinite matrix variable is with rank d 

in the hierarchy. 

• In contrast to the LP-hierarchy Q, finite convergence occurs at the first step in the 
hierarchy for a large class of convex problems; typically convex problems defined with convex 
quadratic polynomials or SOS-convex polynomials of degree at most k. Recall that such finite 
convergence is impossible for the LP-hierarchy Q. 

• Just as in the standard SOS-hierarchy ([3]), there also exists a sufficient condition for finite 
convergence of the hierarchy. Namely it suffices to check whether at an optimal solution of the 
corresponding SDP, some associated moment matrix is rank-one. 

• Last but not least, to implement this hierarchy one uses important techniques that dramat¬ 
ically alleviate the computational burden associated with a standard (careless) implementation. 
Namely, (a) to declare that two polynomials are identical one uses that their values are equal 
on finitely many randomly chosen points (instead of equating their coefficients), and (b) the 
SDP solver SDPT3 [28l [29] can be used to handle efficiently some type of matrices used in our 
positivity certificate. 

Preliminary computational experiments First we have compared our results with those 
obtained with the GloptiPoly software [13] (devoted to solving the SOS-hierarchy (l3l)) on a 
sample of non convex problems with up to 20 variables. For problems with low degree (in the 
initial data) and/or low dimension we obtain the global optimum whereas good lower bounds are 
always obtained for problems with high degee or higher dimension (e.g. problems with degree 4 
and up to 20 variables). 

Next, we have also tested the LP-hierarchy 0 on a sample of convex problems and as 
expected the convergence is very poor and the resulting LPs become ill-conditioned. In addition, 
the LP can be expensive to solve as the LP data is typically dense. In contrast, the new hierarchy 
(with smallest value A; = 1 of its parameter) converges at the first step even though some of the 
problems are defined with polynomials of degree larger than 2. 

We have also considered a sample of non convex quadratic problems of the form uii{x^Ax : 
X € A} where A C M"' is the canonical simplex and A is a randomly generated real symmetric 
matrix with r negative eigenvalues and n — r positive eigenvalues. For all problems that could 
be solved with GloptiPoly (up to n = 20 variables) we obtain the optimal values. For the other 
problems with n = 40, 50,100 variables, only the first (dense) relaxation of GloptiPoly can be 
implemented and yields only a lower bound on the global optimum. For those problems, a better 
lower bound is obtained in a reasonable amount of time by running the BSOS hierarchy. 

Finally we have considered the minimization of quadratic and quartic polynomials (with 
up to 40 variables) on the Euclidean unit ball intersected with the positive orthant. Again in 
those examples only the first SDP-relaxation of GloptiPoly can be implemented, providing only 
a lower bound. In contrast BSOS solves all problems at step 2 of the hierarchy in a reasonable 
amount of time. 

Of course this new hierarchy of semidefinite relaxations also has its drawbacks (at least in 
its present version). Namely some submatrix (of the matrix used to describe the linear equality 
constraints of the resulting SDP) is fully dense and many of these linear constraints are nearly 
dependent, which yields a lack of accuracy in the optimal solution when the order of relaxation 
d is increased. 
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2 Main result 


2.1 Notation and definitions 

Let M[3:] be the ring of polynomials in the variables x = (xi,... ,Xn)- Denote by M[x]rf C M[x] 
the vector space of polynomials of degree at most d, which forms a vector space of dimension 
s{d) = with e.g., the usual canonical basis (x“) of monomials. Also, denote by S[x] C M[x] 

(resp. T,[x\d C M[x] 2 (i) the space of sums of squares (SOS) polynomials (resp. SOS polynomials 
of degree at most 2d). If / G K[x]d, we write f{x) = faX°‘ in the canonical basis and 

denote by / = (/q) G its vector of coefficients. Finally, let 5” denote the space of n x n 
real symmetric matrices, with inner product (A, B) = trace AB. We use the notation A ^ 0 
(resp. A >- 0) to denote that A is positive semidefinite (definite). With qq := 1, the quadratic 
module Q{gi,... .,gm) C M[x] generated by polynomials gi,... ,gm, is defined by 

{ m 

'^(Jjgj : aj G S[x] > . 
j=0 

We briefly recall two important theorems by Putinar [23] and Krivine-Stengle [laiiTi respec¬ 
tively, on the representation of polynomials that are positive on K. 

Theorem 1. Let go = 1 and K in be compact. 

(a) If the quadratic polynomial x M — \\x\\‘^ belongs to Q{gi,... ,gm) and if f ^ M[x] is 
strictly positive on K then f & Q{gi,... ,gm)- 

(b) Assume that 0 < gj < 1 on K for every j, and the family {1,5^} generates M[x]. If f is 
strictly positive on K then 

f = [J ( 5 “^ (1 - gj)^^^ , 

j 

for some (finitely many) nonnegative scalars (cap). 


2.2 The Bounded-SOS-hierarchy (BSOS) 

Consider the problem 


(P) : f* = min{/(x) | x G K} 


where K C M"' is the basic semi-algebraic set dehned in ([2|), assumed to be compact. Moreover 
we also assume that gj{x) < 1 for all x G K and j = 1,... ,m, and {1,5'j} generates the ring of 
polynomials M[x]. With A: G N fixed, consider the family of optimization problems indexed by 
d G N: 

:= sup {t I Ld{x, A) — t G S[x]fe, A > 0 }, d G N. (5) 

A,t 

Observe that when k is fixed, then for each d G N: 


• Computing q^ in ([5|) reduces to solving a semidefinite program and therefore ([5|) defines a 
hierarchy of semidefinite programs because q^+i > q^ for all d G N. 

• The semidehnite constraint is associated with the constraint Ld{x,X) — t S[x]fc and 

the associated matrix has fixed size , independent of d G N, a crucial feature for 

computational efficiency of the approach. 

• If A: = 0 then ([5|) is the linear program Q and so 9d = q^< q^ for all d, k. 
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Interpretation. For any fixed d > 1, problem (P) is easily seen to be equivalent to the 
following problem by adding redundant constraints: 

(P) : f* = mm{f{x) \ Kfi{x) >0 V {a, P) € N^"*} 

where = {(q;,/ 3) G | |a| + \j3\ < d} and hajs G M[x] is the polynomial 

m 

X ^ hapix) := Y\gj{x)'^^ {1 - gj{x))^\ x 
i=i 

Given A = (Xa/s), {cx,l3) G consider the Lagrangian function: 

X ^ Ld{x,X) = f{x) - ^ XajiKjiix), xGM”. 

(a,/3)eN2- 


The Lagrangian dual of (P) is given by 

(PJ): sup{Grf(A): A>0} 

A 

where the function Grf(') is given by: 

A i-G Grf(A) := inf {Lrf(a;,A)}, A > 0. 

Now for a fixed A, the evaluation of Grf(A) is computational intractable. However, let A: G N 
be fixed and observe that 

Gd{X) = inf Ld{x,X) = sup {t | Lrf(a;, A) — t > 0, Vx} 

xGR" f 

> sup{t I Lrf(x,A)-t G i;[x]fc}, 

t 

where recall that S[x]fc is the space of SOS polynomials of degree at most 2k. Moreover, 

r > sup Grf(A) > g^, VdGN. 

A>0 

So the semidefinite program ([5]) can be seen as a tractable simplification of the intractable 
problem: sup;,>Q G(A). The linear program Q (which is ([5]) with k = 0) is an even more brutal 
simplification, so that = 0^ for all d, k. As a matter of fact we have the more precise 

and interesting result. 

Theorem 2 ([H]). Let K C M” in be compact with nonempty interior and gjix) < 1 for 
X G K and j = 1,... ,m. Assume further that the family {l,gj} generates the algebra M[x]. Let 
k be fixed and for each d G N, let q^ be as in Then: 

(a) The sequence {q^), d G N, is monotone nondecreasing and q^ ^ f* as d ^ oo. 

(b) Moreover, assume that Slater’s condition holds, i.e., there exists xq G K such that 
gj{xo) > 0 for all j = 1,... ,m. If f and —gj, j = l,...,m, are SOS-conve^ polynomials 
of degree at most 2k then qi = f*, i.e., finite convergence takes places at the first relaxation in 
the hierarchy! In particular when /, —gj are convex quadratic polynomials then q\ = /*. 

polynomial / € R[a:] is SOS-convex if its Hessian V^/ is an SOS matrix, i.e., V^f{x) — L{x) L{x)^ for 
some matrix polynomial L € and some p G N. 
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Proof. The first result is a direct application of Theorem [IJb) since for any integer d, k, f* > 
= Od, and by Theorem [U — )■ /* as d —)• oo. Next, if Slater’s condition holds and / 

and —Qj are SOS-convex, j = 1,... ,m, then there exist nonnegative Lagrange-KKT multipliers 
A e such that 

V/(x*) - = 0; Xjgjix*) = 0, j = 

j 

In other words, the Lagrangian x i-)- L{x) := f{x) — f* — Yhj Xj gj{x) is SOS-convex and satishes 
L{x*) = 0 and VL(x*) = 0. By Helton and Nie [HI Lemma 8, p. 33], L is SOS (of degree at 
most 2k). 

□ 


2.3 The SDP formulation of ([5]) 


To formulate ([5]) as a semidefinite program one has at least two possibilities depending on how 
we state that two polynomials p,q G are identical. Either by equating their coefficients (e.g. 
in the monomial basis), i.e., pa = qa for all a G N^, or by equating their values on generic 

points (e.g. randomly generated on the box [—1,1]”). In the present context of (|5]) we prefer 
the latter option since expanding the polynomial h^^ix) symbolically to get the coefficients with 
respect to the monomial basis can be expensive and memory intensive. 

Let r = max{deg(/), 2/i:, dmaxj{deg( 5 'j)}}. Then for k hxed and for each d, we get 


qd 


sup I f{x) - t- ^ 

(a,p)eNf’ 


Xa0 Kpix) = {Q,Vk{x)Vk{x)^)-, 


sup < t 


Qg5+^^\a>o} 

/(x(P)) = t + E(a,/3)eN2- -^a/3 + {Q, Vk{x^P'>)vk(x^P'>)^), 

p = 1, ..., L, Q G A > 0, t gM. 


( 6 ) 

(7) 


where L := |N(1| = and {x^p^ G M” | p = 1,... , L} are randomly selected points in [—1,1]""; 

s{k) = and Vk{x) is a vector of polynomial basis for the space of polynomials of 

degree at most k. To be rigorous, if the optimal value q^ of ([U]) is hnite then the above equality 
holds with probability one and every optimal solution {q^,X*,Q*) of ([6]) is also an optimal 
solution of (|7|). 


2.4 Sufficient condition for finite convergence 

By looking at the dual of the semidefinite program (|7]) one obtains a sufficient condition for 
hnite convergence. To describe the dual of the semidehnite program ([7|) we need to introduce 
some notation. 

For every p = 1,... ,L, denote by 6^(p) the Dirac measure at the point x^p'^ G M and let 
(g, 6^(p)) = q{x^P^) for all p = 1,..., L, and all q G M[x]. 

With a real sequence y = (yo), a G denote by M£(y) the moment matrix associated 
with y. It is a real symmetric matrix with rows and columns indexed by N”, and with entries 

Me{y){a,P) = y„+/3, Vq;,/3gN^. 
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Similarly, for j = 1,... ,m, letting gj{x) = denote by M.i{gjy) the localizing matrix 

associated with y and gi € M[x]. Its rows and columns are also indexed by N”, and with entries 


M£(5jy)(a,/3) = gj^ya+p+'y, Va,/3GN£. 
7eN'" 


The dual of the semidefinite program d?]) reads: 


P=1 

L 

s.t. '^ep{vk{x^'P'>)vk{x^^^)'^) ^ 0 

P=1 

L 

(a,/3)€N2- 

p=i 

L 

= 1 . 

p=l 


( 8 ) 


(Notice that the weights 6p are not required to be nonnegative.) By standard weak duality in 
convex optimization, and for every fixed A: G N, one has 

r > g1 > VdGN. 


(In full rigor, for each fixed d the above inequality holds with probability one.) Next, let s G N 
be the smallest integer such that 2s > max[deg(/); deg( 5 (j)], and let r := maxj[deg((7j)/2]. We 
have the following verification lemma. 

Lemma 1. Let K in ([^ be compact with nonempty interior and assume that there exists xq ^ K 
such that 0 < gj{xo) < 1 for all j = 1,..., m. 

(a) For every d sufficiently large (say d> do), the semidefinite program ^ has an optimal 
solution. Hence for each fixed d > do, with probability one the semidefinite program 0 has also 
an optimal solution. 

(b) Let 9* G be an optimal solution of ^ (whenever it exists) and let y* = {y(f), a G 
with 

L 

yl-.= Y.e;{x^)r, aGN^,. (9) 

p=i 

• //rank (y *) = 1 then = f* and x* = (y^), |a| = 1, i.e., x* = Y!ip=i ^p 

optimal solution of problem (P). 

• IfMsiy*) h 0; Ms_r(yjy*) h 0, j = 1,... ,m, and rankM 5 (y*) = rankM 5 _^(y*), then 
9d ~ f* problem (P) has rankMs(y*) global minimizers that can be extracted by a linear 
algebra procedure. 

The proof is postponed to the Appendix. Notice that we do not claim that problem ([8]) has 
always an optimal solution. Lemma [T] is a verification lemma (or a stopping criterion) based on 
some sufficient rank condition on M 5 (y*) and lVIs_r(y), provided that an optimal solution y* 
exists. When the latter condition holds true then f* = and we can stop as at least one global 
optimal solution x* ^ K has been identified. 
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2.5 On the rank-one matrices of ([5]) and SDPT3 

Note that in the SDP ([7|), the constraint matrices associated with Q are all dense rank-1 matrices 
of the form Ap = . Thus if we let Vp = Vk{x^')), then the linear maps involved 

in the equality constraints of the SDP can be evaluated cheaply based on the following formulas: 


.4(X) := =\{vp,Xvp)] , A*y:=y^ypAp = VBmg{y)V^ 

J p=l L J p=l ^—' 


y=l 


where X € y € V = [vi,... ,vl] G Moreover, one need not store the 

dense constraint matrices {Ap \ p = 1,..., L} but only the vectors {vp \ p = 1,..., L}. To 
solve the SDP © efficiently, we need to exploit the rank-1 structure of the constraint matrices 
during the iterations. Fortunately, the SDPT3 solver [281 [29] based on interior point methods 
has already been designed to exploit such a rank-1 structure to minimize the memory needed to 
store the constraint matrices, as well as to minimize the computational cost required to compute 
the Schur complement matrix arising in each interior-point iteration. More precisely, in each 
iteration where a positive definite matrix W G is given, one needs to compute the Schur 
complement matrix S whose (p, q) element is given by 

Spq = {Ap,WAgW) = {vpVp, WvqVgW) = {vp, Wvqf, p,q = l,...,L. 

It is the combination of these two implementation techniques (point evaluation in the for¬ 
mulation and exploiting rank-one structure in the interior point algorithm) that makes our 
implementation of the SOS-hierarchy ([5|) efficient. 


3 Computational issues 

Given / G M[x]rf, in order to efficiently evaluate the vector f{x^P'l), p = we need a 

convenient representation of the polynomial f{x). In our implementation of BSOS, we use the 
following data format to input a polynomial: 

F{i,l :n+l) = [a^, fa] 

where fa is the zth coefficient corresponding to the monomial Note that the enumeration 
of the coefficients of f{x) is not important. For a given point z G M” such that Zi ^ 0 for all 
i = 1,..., n, we evaluate f{z) via the following procedure written in Matlab syntax: 

Step 1. Set P = F{:, 1 : n), / = F{:, n 1), and s = (si,..., where Si = 1 if Zi < 0, and 

Si = 0 if Zi > 0. 

Step 2. Compute s = rem(Ps, 2) and 2 : = exp(P log [zl). 

Step 3. Compute fiz) = (/(“), where = /(find(s == 0)) and = 

/(find(s == 1)). 

(The above procedure can be modified slightly to handle the case when 2 : has some zero compo¬ 
nents.) Note that in the above procedure, and correspond to the sum of 

positive terms and sum of negative terms in the evaluation of f{z). By separating the summa¬ 
tion of the positive and negative terms in the evaluation of f{z), it is hoped that cancellation 
errors can be minimized. 

We should mention that some of the equality constraints in ([7|) may be redundant. For the 
sake of reducing the computational cost and improve the numerical stability, we remove these 






redundant constraints before solving the SDP. However, as d increases, the linear constraints 
would become more and more nearly dependent, and typically the SDP problem cannot be 
solved accurately by either SDPT3 or SEDUMI. 

Another numerical issue which we should point out is that the constraint matrix 

associated with the nonnegative vector {Xai3) is typically fully dense. Such a matrix would 
consume too much memory and also computational cost when d increases or when m is large. 

4 Numerical experiments 

We call our approach BSOS (for hierarchy with bounded degree SOS). As mentioned in the 
Introduction, we conduct experiments on three classes of problems which will be described in 
the ensuing subsections. 

4.1 Comparison of BSOS with Gloptiploy 

We construct a set of test functions with 5 constraints. The test functions are mainly generated 
based on the following two problems: 


(Pi) 

/ = 

xl 

-xl 


+x| 

^2 

X4 

+Xl 

-X2 

s.t. 0 

<gi = 

2 x\ 

+3x1 

+ 2 xiX 2 

+2x| 

+ 3 x| 

+2x3X4 

< 1 

0 

<92 = 

3xi 

+ 2 x 1 

— 4 xiX 2 

+ 3 x 1 

+2x4 

—4x3X4 

< 1 

0 

<93 = 

xj 

+6x| 

— 4 xiX 2 

+4 

+6x4 

—4x3X4 

< 1 

0 

< 94 : = 

xl 

+ 4 x 1 

— 3 xiX 2 

+4 

+ 4 x| 

—3x3X4 

< 1 

0 

0 

<93 = 

< X. 

2x1 

+ 5 X 2 

+ 3 xiX 2 

+ 2 x 1 

+5x4 

+3x3X4 

< 1 


The optimal value of (Pi) is f{x*) = —0.57491, as computed by GloptiPolyS. For BSOS, we get 
the result = —0.57491, which is the exact result. 

The second problem is : 


(^2) 


/ = 

2 

X1X2 

+X1X2 

™2™2 

X1X2 


S.t. 

0 

<91 = 

xl 

+4 


< 1 


0 

<92 = 

3 x 1 

+ 2 x 1 

— 4 xiX 2 

< 1 


0 

<93 = 

^2 

Xl 

+6x| 

—8x1X2 + 2.5 

< 1 


0 

<94 = 

xf 

+ 3 x 1 


< 1 


0 

<95 = 

^2 

Xl 

+4 


< 1 


0 < Xi, 0 < X2. 

The optimal value of (P 2 ) is f{x*) = —0.037037, as computed by GloptiPoly3. The results 
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obtained by BSOS are 

qk=l = -0.041855, g^=| = -0.037139, g^=| = -0.037087 
qk=l = -0.037073, g^=| = -0.037046 
qk=f = -0.038596, g^=| = -0.037046, g^=| = -0.037040 
g^=| = -0.037038, = -0.037037. 

Based on the above two problems, we increase the degree of the objective function and constraint 
functions to generate other test instances which are given explicitly in the Appendix. 

Table [T] compares the results obtained by BSOS and GloptiPoly3 for the tested instances. 
We observe that BSOS can give the exact result for those problems with either low degree or 
low dimension, while also providing a good lower bound for high degree and high dimensional 
problems. In particular on this sample of problems, k is chosen so that the size of the semidef- 
inite constraint (which is ("’^^)) is the same as the one needed in GloptiPoly, to certify global 
optimality. Then notice that BSOS succeeds in finding the optimal value even though the posi¬ 
tivity certificate used in ([7]) is not Putinar’s certificate ([3]) used in GloptiPoly. In addition, for 
most of test problems, BSOS can usually get better bounds as d increases, and in most cases, 
the bound is good enough for small d = 2,3. 

In Table [H we also use the sufficient condition stated in Lemma [T] to check whether the 
generated lower bound is indeed optimal. For quite a number of instances, the moment matrix 
M£(y*) associated with the optimal solution 9* of ([8]) indeed has numerical rank equal to one 
(we declare that the matrix has numerical rank equal to one if the largest eigenvalue is at least 
10 ^ times larger than the second largest eigenvalue), which certifies that the lower bound is 
actually the optimal value. We should note that for some of the instances, although the lower 
bound is actually the optimal value (as declared by GloptiPoly), but the rank of the moment 
matrix M£(y*) is larger than one. 


4.2 Comparison of BSOS with the LP relaxations of Krivine-Stengle on con¬ 
vex problems 


Here we compare the performance of BSOS with the LP relaxations of Krivine-Stengle on convex 
problems where each test problem has 5 constraint functions in addition to the nonnegative 
constraint x > 0. Note that the LP relaxation problem has exactly the same form as in ([7]), 
except that the positive semidefinite matrix variable Q is set to 0. We should mention that even 
though the Krivine-Stengle scheme generates LP problems instead of SDP problems, the size 
of the corresponding LP problems also increases rapidly with d, like for the BSOS scheme. In 
particular, in both LP- and BSOS-relaxations, the dimension of the nonnegative variable A is 
^ 2 m+d'^^ and the constraint matrix is fully dense. (The BSOS-relaxations include an additional 
semidefinite constraint with fixed matrix size ("’fc^)-) The following example illustrates the 
performance of LP relaxation method: 


(Cl) 


min / 



xf 

+xf 

+2xfxf 

s.t. 0 

< 

91 = 

-- —xf 

-2xf 

+1 

0 

< 

92 = 

-- -2xf 

-xf 

+1 

0 

< 

93 = 

-- -xf 

-4x1 

+1.25 

0 

< 

94 = 

-- -4xf 

4 

— X 2 

+1.25 

0 

< 

95 = 

-- -2xf 

-3xf 

+1.1 

0 

< 

Xl 




0 

< 

X2. 
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Table 1: Comparison of BSOS and GloptiPolyS. An entry marked with means that the 
correspond SDP was not solved to high accuracy. 


Problem 

BSOS 

GloptiPolyS 


(d, k) 

Result 

Time(s) 

rank(M(y'^)) 

Result 

Time(s) 

Order,Optimal 

P4_2 

1,1 

-6.7747e-001 

0.3 

1 

-6.7747e-001 

0.2 

l,yes 


2,1 

-6.7747e-001 

0.5 

1 




P4_4 

1,2 

-2.9812e-001 

0.5 

7 

-3.3539e-002 

0.3 

2,yes 


2,2 

-3.3539e-002 

0.6 

4 




P4_6 

1,3 

-6.2500e-002 

0.8 

31 

-6.0693e-002 

0.5 

3,yes 


2,3 

-6.0937e-002 

0.9 

7 





3,3 

-6.0693e-002 

1.8 

4 




P4_8 

1,4 

-9.3354e-002* 

3.2 

> 10 

-8.5813e-002 

2.6 

4,yes 


2,4 

-8.5813e-002 

3.7 

9 





3,4 

-8.5813e-002 

5.1 

4 




P6_2 

1,1 

-5.7491e-001 

0.3 

1 

-5.7491e-001 

0.2 

l,yes 


2,1 

-5.7491e-001 

0.8 

1 




P6_4 

1,2 

-5.7716e-001 

1.1 

10 

-5.7696e-001 

0.3 

2,yes 


2,2 

-5.7696e-001 

1.1 

4 





3,2 

-5.7696e-001 

4.3 

1 




P6_6 

1,3 

-6.5972e-001 

7.1 

> 10 

-4.1288e-001 

6.4 

3,yes 


2,3 

-6.5972e-001 

10.2 

> 10 





3,3 

-4.1288e-001 

32.0 

1 




P6_8 

1,4 

-6.5973e-001 

74.2 

> 10 

-4.0902e-001 

207.2 

4,yes 


2,4 

-6.5973e-001 

168.6 

> 10 





3,4 

-6.5973e-001 

264.1 

> 10 





4,4 

-4.0928e-001* 

1656.0 

1* 




8 var, deg 2 

1,1 

-5.7491e-001 

0.5 

1 

-5.7491e-001 

0.3 

l,yes 


2,1 

-5.7491e-001 

0.9 

1 




8 var, deg 4 

1,2 

-6.5946e-001 

2.8 

> 10 

-4.3603e-001 

1.5 

2,yes 


2,2 

-4.3603e-001 

4.8 

1 




8 var, deg 6 

1,3 

-6.5973e-001 

127.1 

> 10 

-4.1288e-001 

161.3 

3,yes 


2,3 

-6.5973e-001 

126.6 

> 10 





3,3 

-4.1322e-001* 

258.7 

1* 




10 var, deg 2 

1,1 

-5.7491e-001 

0.4 

1 

-5.7491e-001 

0.2 

l,yes 


2,1 

-5.7491e-001 

1.0 

1 




10 var, deg 4 

1,2 

-6.5951e-001 

7.8 

1 

-4.3603e-001 

5.3 

2,yes 


2,2 

-4.3603e-001 

20.0 

1 





3,2 

-4.3603e-001* 

66.7 

1* 




20 var, deg 2 

1,1 

-5.7491e-001 

1.2 

1 

-5.7491e-001 

0.4 

l,yes 


2,1 

-5.7491e-001 

3.0 

1 




20 var, deg 4 

1,2 

infeasible 

302.1 

- 

-4.3603e-001 

5600.8 

2,yes 


2,2 

-4.3602e-001* 

1942.2 

1* 
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For this problem, the functions / and —gi’s are all convex. The optimal value for this problem 
is f{x*) = —0.7500, as computed by GloptiPolyS. For BSOS, we get = —0.7500, and we 
obtained the exact result by just choosing d = 1. This observation is consistent with Theorem 
4.1 in |18] . For the LP relaxation method, we get the following values for various choices of d: 

qd=i = infeasible, q ^£2 = -1.2200, = -1.0944, q^E^ = -0.9696, q^E^ = fail. 

Observe that when d increases, we could get a better lower bound for the exact optimal value. 
However, as d increases, the LP relaxation problem would become increasing ill-posed and the 
solver has difficulty in solving LP problem accurately. In particular, for d = 5, both the solvers 
SeDuMi and SDPT3 fail to compute an accurate enough solution for the LP to generate a 
sensible lower bound for f{x*). 

In Table El we observe that BSOS can achieve the exact result with d = 1 for all the test 
instances. In contrast, the LP relaxation method of Krivine-Stengle does not perform very well 
even though the test instances are convex problems. In particular, observe that for the last 
instance C20_2, the LP relaxation method cannot produce a good lower bound even when we 
choose d = 3, and the time taken to solve the correspond LP is about 40 minutes. 


Table 2: Comparison of BSOS with LP relaxations of Krivine-Stengle on convex 
problems. 



LP 

BSOS 

GloptiPolyS 


d 

Result 

Time(s) 

k 

Result 

Time(s) 

Result 

Time(s) 

Order,Optimal 

C4_2 

1 

infeasible 


1,1 

-2.5000e-001 

0.4 

-2.5000e-001 

0.2 

l,yes 


2 

-9.0000e-001 

0.1 








3 

-5.8852e-001 

0.3 








4 

-4.2500e-001 

5.6 








5 

-3.4975e-001 

98.4 








6 

-3.1001e-001 

4074.1 







C4_4 

< 3 

infeasible 


1,2 

-6.9574e-001 

0.6 

-6.9574e-001 

0.2 

2,yes 


4 

-1.1094e+000 

16.9 








5 

-8.8542e-001 

788.4 







C4_6 

< 5 

infeasible 


1,3 

-1.1933e+000 

1.5 

-1.1933e-|-00C 

0.5 

3,unknown 


6 

fai’ 








C6_2 

1 

infeasible 


1,1 

-2.5000e-001 

0.3 

-2.5000e-001 

0.2 

l,yes 


2 

-9.0000e-001 

0.1 








3 

-5.8852e-001 

0.6 








4 

-4.2500e-001 

66.3 








5 

-3.4975e-001 

4069.3 







C6_4 

< 3 

infeasible 


1,2 

-6.9574e-001 

1.3 

-6.9574e-001 

0.4 

2,yes 


4 

-1.1094e+000 

177.5 







C6_6 

< 5 

infeasible 


1,3 

-1.1933e+000 

1.3 

-1.1933e-|-00C 

0.4 

3,unknown 


6 

out of memory 








C8_2 

1 

infeasible 


1,1 

-2.5000e-001 

0.4 

-2.5000e-001 

0.2 

l,yes 


2 

-9.0000e-001 

0.1 








3 

-5.8852e-001 

3.5 








4 

-4.2500e-001 

508.8 







C8_4 

< 3 

infeasible 


1,2 

-6.9574e-001 

3.3 

-6.9574e-001 

1.2 

2, yes 


4 

-1.1094e+000 

1167.3 







C10_2 

1 

infeasible 


1,1 

-2.5000e-001 

0.8 

-2.5000e-001 

0.3 

l,yes 


2 

-9.0000e-001 

0.1 








3 

-5.8852e-001 

15.8 








4 

-4.2500e-001 

9993.0 







C10_4 

< 3 

infeasible 


1,2 

-6.9574e-001 

11.4 

-6.9574e-001 

5.5 

2, yes 


4 

-1.1094e+000 

5544.2 







C20_2 

1 

infeasible 


1,1 

-2.5000e-001 

1.7 

-2.5000e-001 

0.4 

l,yes 


2 

-9.0000e-001 

0.9 








3 

-5.8852e-001 

2398.0 
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4.3 Performance of BSOS on quadratic problems with polyhedral constraints 

Here consider the following problem: 

min x^Ax 

rr. (10) 

s.t. e^x <1, X > 0, X e M"', 

where H is a given nx n symmetric matrix. In our numerical experiments, we generate random 
instances such as Qnl0_r2 for which re = 10 and A is randomly generated so that it has r = 2 
negative eigenvalues and n — r positive eigenvalues as follows: 

rng(’default’) 

A1 = randn(n); A2 = A1*A1’; perm=randperm(n); 

[V,D] = eig(A); eigval=diag(D); idxl=perm(l:r); idx2=perm(r+l:n); 

V1=V(:,idxl); V2=V(:,idx2); dl=eigval(idxl); d2=eigval(idx2); 

A = V2*diag(d2)*V2’ - Vl*diag(dl)*V1’; 

Table [3] compares the performance of BSOS and GloptiPolyS. From the numerical results, 
we can see that BSOS is far more efficient than GloptiPolyS in solving the problems (HOI) . For 
example, for the problem Qn20_r2 with re = 20, BSOS took only 1.9 seconds to generate the 
lower bound —2.0356e3 for the problem, but GloptiPolyS took more than 1 hour to generate 
the same bound. The disparity in the efficiency between BSOS and GloptiPolyS is expected to 
become even wider for other instances with re larger than 20. 

In Table [Sj we again use the sufficient condition stated in Lemma [T] to check whether the 
generated lower bound is indeed optimal. For each of the first eight instances, the moment 
matrix M£(y*) associated with the optimal solution 9* of ([8]) has numerical rank equal to one 
(we declare that the matrix has numerical rank equal to one if the largest eigenvalue is at least 
10 ^ times larger than the second largest eigenvalue), which certifies that the lower bound is 
actually the optimal value. 


Table 3: Gomparison of BSOS and GloptiPolyS on quadratic problems with polyhedral con- 


straints. 


Problem 

BSOS 

GloptiPolyS 

(d, k] 

Result 

Time(sJ 

rank(M£(y*)) 

Ordei 

Result 

Time(s) 

Optimal 

qnl0_r2 

1,1 

infeasible 

0.8 


1 

infeasible 

0.1 


n = 10, r = 2 

2,1 

-2.8023e+000 

0.5 

1 

2 

-2.8023e+000 

2.8 

yes 

Qnl0_r5 

1,1 

infeasible 

0.7 


1 

infeasible 

0.1 


n = 10, r = 5 

2,1 

-1.9685e+001 

0.4 

1 

2 

-1.9685e+001 

2.3 

yes 

Qn20_r2 

1,1 

infeasible 

1.5 


1 

infeasible 

0.1 


n = 20, r = 2 

2,1 

-2.0356e-003 

1.9 

1 

2 

-2.0356e-003 

4057.0 

yes 

Qn20_r5 

1,1 

infeasible 

1.7 


1 

infeasible 

0.1 


n = 20, r = 5 

2,1 

-1.7900e+001 

1.0 

1 

2 

-1.7900e+001 

3587.4 

yes 

Qn40_r4 

1,1 

infeasible 

10.9 


1 

infeasible 

1.2 


n = 40, r = 4 

2,1 

-7.0062e+000 

10.9 

1 





Qn50_r5 

1,1 

infeasible 

24.9 


1 

infeasible 

1.5 


n = 50, r = 5 

2,1 

-5.9870e+000 

34.8 

1 





Qnl00_rl0 

1,1 

infeasible 

385.8 


1 

infeasible 

108.7 


n = 100, r = 10 

2,1 

-8.8502e+000 

1617.4 

1 





Problem 2.9 in 

1,1 

infeasible 

0.9 


1 

infeasible 

0.1 


n = 10, r = 6 

2,1 

3.7500e-001 

0.5 

1 

2 

3.7500e-001 

2.7 

yes 

A=-toeplitz([0,1,1,1,1,zeros(1,10)]) 

1,1 

infeasible 

1.2 


1 

infeasible 

0.1 


n = 15, r = 3 

2,1 

-8.0000e-001 

0.6 

11 

2 

-8.0087e-001 

233.7 

unknown 

A=-toeplitz([0,1,1,zeros(1,17)]) 

1,1 

infeasible 

1.9 


1 

infeasible 

0.2 


n = 20, r = 7 

2,1 

-6.6667e-001 

1.3 

18 

2 

-6.6905e-001 

4753.3 

unknown 
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4.4 Performance of BSOS on higher order problems with more variables 

Here we consider the following problem: 

min E|a|<£Cax“ 

s.t. Xj > 0, z = l,...n (11) 

where ^ = 2 or £ = 4 and are randomly generated in [—1,1]. In our numerical experiments, 
we generated instances such as Hn20_4 for which n = 20 and the degree of the polynomial is 4. 
The problem is hnd the minimal value of a polynomial on the Euclidean unit ball intersected 
with the positive orthant. 


Table 4: Comparison of BSOS and GloptiPolyS on higher order problems with more variables. 


Problem 

BSOS 

GloptiPolyS 


(d, k] 

Result 

Time(s) 

i'ank{M^(y*)) 

Ordei 

Result 

Tim6(s) 

Optimal 

Hn20_2 

1,1 

-2.7002e+000 

1.1 

2 

1 

-2.7002e-|-000 

2.3 

unknown 

n = 20,£ = 2 

2,1 

-2.3638e+000 

1.5 

1 

2 

out of memory 



Hn20_4 

1,2 

-2.1860e+000 

254 

> 10 

1 

out of memory 



n = 20J = 4 

2,2 

-1.5943e+000 

294 

1 





Hn30_2 

1,1 

-2.1320e+000 

2.0 

2 

1 

-2.13206-1-000 

2.5 

unknown 

n = 30,£ = 2 

2,1 

-1.8917e+000 

12 

1 

2 

out of memory 



Hn30_4 

1,2 

-3.1126e+000 

418 

> 10 

1 

out of memory 



n = 30,£ = 4 

2,2 

-1.0781e+000 

512 

1 





Hn40_2 

1,1 

-2.3789e+00C 

4.6 

2 

1 

-2.37896-1-000 

4.0 

unknown 

n = 40,£ = 2 

2,1 

-2.1138e+000 

29 

1 

2 

out of memory 



Hn40_4 

1,2 

-3.2917e+000 

812 

> 10 

1 

out of memory 



n = 40J = 4 

2,2 

-1.6531e+000 

1102 

1 






Table [4] displays the respective performance of BSOS and GloptiPolyS. From the numerical 
results, we can see that BSOS is far more efficient than GloptiPolyS in solving problems dill) . 
For example, for problem Hn20_4 (with n = 20 variables and degree £ = 4), BSOS took about 
250s to generate the first lower bound —2.1860, and took nearly 300s to generate a better lower 
bound of —1.5943, which is also the exact optimal value for the problem. But GloptiPolyS got 
out of memory when solving the same problem. Similarly for problem Hn40_2, it took BSOS and 
GloptiPolyS very little time to generate the first lower bound of —2.3789. To get a better lower 
bound, it took BSOS 29s to generate the optimal value of the problem. In contrast GloptiPolyS 
got out of memory for improving the bound. From our observations, the disparity in efficiency 
between BSOS and GloptiPoly will become wider for instances with larger n and/or of higher 
degree. 

5 Conclusion 

We have described and tested a new hierarchy of semideifinite relaxations for global polynomial 
optimization. It tries to combine some advantages of previously defined LP- and SOS-hierarchies. 
Essentially, it uses a positivity certificate already used in the LP-hierarchy but with an additional 
semidefinite constraint which thus makes it an SOS-hierarchy. However the main and crucial 
point is that the size of this additional semidefinite constraint is fixed in advance and decided 
by the user (in contrast to the standard SOS-hierarchy in which the size of the semidefinite 
constraint increases in the hierarchy). Preliminary results are encouraging especially for non 
convex problems on convex polytopes where problems with up to 100 variables have been solved 
in a reasonable amount of time (whereas the standard SOS-hierarchy of GloptiPoly cannot be 
implemented). 
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For problems of larger size one needs to consider some serious numerical issues due to the 
presence of some fully dense submatrix and some nearly dependent linear constraints. In ad¬ 
dition, to be able to handle large-scale problems one also needs to provide a “sparse version” 
of this hierarchy, an analogue of the sparse version of the SOS-hierarchy defined in [30]. Both 
issues (a topic of further investigation) are certainly non trivial, in particular the latter issue be¬ 
cause the positivity certificate used in this new hierarchy involves products of initial polynomial 
constraints, which destroys the sparsity pattern considered in m- 


Appendix 

Before proving Lemma[T]we need introduce some notation. For r > 2 and a sequence y = (ua) S 
N”, let Ly : ^ M be the Riesz functional: 



^ Lyif) ■= ^ faVa, 
aGN” 


/ G M[x]r, 


and let Mfe(y) be the moment matrix of order k, associated with y. If 5 G M[x]fc with coefficient 
vector q = {qa), then (q, Mfc(y)q) = Ly(g^) and if y is the (truncated) moment sequence of a 
measure /r. 


(q,Mfc(y)q) = Ly(g^) = j q{xf dn{x). 


Proof of Lemma [T] 

(a) We Hrst prove that the dual of (l6|) which is the semidefinite program: 

:= inf {Ly(/) : Mfe(y) ^ 0; Ly(I) = 1; Ly(h„p) > 0, (a,/3) G NM (12) 

satisfies Slater’s condition. Recall that K has nonempty interior; so let y be the sequence of 
moments of the Lebesgue measure // on K, scaled to be a probability measure, so that Fy(l) = 1- 
Necessarily Mfc(y) 0. Otherwise there would exists 0 ^ q £ M[x]fc such that 

(q,Mfc(y)q) = [ q{xfdn{x) = 0. 

Jk 

But then q vanishes almost everywhere on K, which implies g = 0, a contradiction. 

Next, observe that for each (a,/3) G the polynomial G M[x]r is nonnegative on K 
and since there exists xq £ K such that 0 < gj{xo) < 1 for all j = 1,..., m, there is an open set 
O C K such that ha/six) > 0 on O for all {a,/3) £ Therefore 

Ly(/i„p) = [ > [ hafidfi>0, V(q;,/3) G 

Jk Jo 

Therefore y is a strictly feasible solution of (II2p . that is. Slater’s condition holds true for m- 
Hence = q^ for all d. It remains to prove that q^ > —00. But this follows from Theorem [T](b) 
as soon as d is sufficiently large, say d> do for some integer do- Indeed then —00 < 9d < q^ < f* 
for all d > do- Finally for each hxed d, with probability one Q and d?]) have same optimal value 
q^, and so, an optimal solution {q^, X*,Q*) of ([6|) is also an optimal solution of d?]). 

(b) Let 6* be an optimal solution of dSj) and let y* be as in dSj). 
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• If rank Ms (y*) = 1 then Ms(y*) = Vs{x*) Vs{x*Y' for some x* G M”', and so by definition 
of the moment matrix Ms(y*), y* = (y^), a G is the vector of moments (up to order 2s) 
of the Dirac measure 5x* at the point x*. That is, y* = (x*)“ for every a G But from Q, 


{x*r = yl = ^e;{x^p^r, VaGN^s- 


P=1 


In particular, for moments of order 1 we obtain x* = X]p=i other words, up to 

moments of order 2s, one cannot distinguish the Dirac measure 6x* at x* from the signed 
measure y = J2p (recall that the 9*'s are not necessarily nonnegative). That is, (x*)“ = 

f x^^dSx* = f x°^dn for all a G This in turn implies that for every q G M[x] 2 s: 

L L 

q{x*) = {q,6x*) = (y,//) = {q,^0*pd^ij,)) = ^ 0* y(x(^’)). 

P=1 P=1 

Next, as 9* is feasible for ([8]) and 2s > max[deg(/); deg(yj)], 

0 < J29p(^^d’^x(p)) = (haii,'^OpSx(p)\ = Kfi{x*), V(a,^) : deg(/i«^) < 2s. 

p=i \ p=i / 

In particular, choosing (a,/3) G such that hap = gj (i.e. /3 = 0, a* = Si=j), one obtains 
9j{x*) > 0, y = 1,..., m, which shows that x* G K. In addition, 

r > y1 = Y.^;{f.^xip)) = (f,T.^P^xM) = 

p=i \ p=i / 

which proves that x* a K is an optimal solution of problem (P). 

• If Ms(y*) ^ 0, Ms_r-(yjy*) ^ 0, y = l,...,m, and rankMs(y*) = rankMs_r-(y*) then 
by Theorem |2Ul Theorem 3.11, p. 66], y* is the vector of moments up to order 2s, of some 
atomic-probability measure // supported on v := rankMs(y*) points z{i) G K, i = l,...,n. 
That is, there exist positive weights {wi) C M+ such that 

V V 

'^Wi = l] Wi > 0, i = 

i=l 


2 = 1 


Therefore, 


r > y1 = iz^;{f,K(p)) = E = [ fdy> r, 

p=l qGN" dK 

which shows that q^ = f* ■ In addition 

0 = f* - [ fdy.= [ if*-f)dn = J2^iif*- /(^(*))> 


which implies f{z{i)) = /* for every i = l,...,n. Finally, the v global minimizers can be 
extracted from the moment matrix Ms(y*) by the simple linear algebra procedure described in 
Henrion and Lasserre [ig. □ 
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Appendix 


Test functions for BSOS and GloptiPoly in Table [T] 

Example P4_2 (4 variables, degree 2): 


f = xf — + xi — X 2 ; 

g2 = 3xj + 2^2 — 4x1X2 + 3xg + 2x^ — 4 x 3 x 4 ; 

94 = xj + 4 x 2 — 3 x 1 X 2 + x| + 4x| — 3 x 3 x 4 ; 

Example P4_4 (4 variables, degree 4): 

f _ 4 4 I 4 4. 

J — ^2 v ^3 ^4’ 

92 = 3xj + 2 x| — 4 x 1 X 2 + 3 x 3 + 2 x| — 4 x 3 x 4 ; 
94 = xj + 4 x 2 — 3 x 1 X 2 + X 3 + 4x| — 3 x 3 x 4 ; 


91 = 2x3 + 3 x| + 2x1X2 + 2x3 + 3 x| + 2x3x4; 

'?3 = ^1 + 6x| — 4x1X2 + x| + 6x| — 4x3x4; 

95 = 2X3 + 5 x| + 3 x 1 X 2 + 2X3 + 5 x| + 3x3x4; X > 0, 

91 = 2 xf + 3 x| + 2x1X2 + 2x3 + 3 x| + 2x3x4; 

93 = a^l + 6x| — 4x1X2 + Xg + 6x4 — 4x3x4; 

95 = 2x4 + 5 x| + 3 x 1 X 2 + 2x3 + 5 x| + 3x3x4; X > 0 


Example P4_6 (4 variables, degree 6 ): 

f — rf^4i^2 I „2„4 _ „2™2 I „4„2 i „2„4 _ „2~2. 

92 = 3 X 3 + 2 X 2 — 4 x 1 X 2 + 3 X 3 + 2 x| — 4 x 3 x 4 ; 
94 = x| + 3 x 2 + Xg + 3x|; 


91 = xf + x| + x| + x|; 

93 = Xg + 6 X 2 — 8 x 1 x 2 + Xg + 6 x| — 8 x 3 x 4 + 2.5; 
95 = *1 + 3^2 + *3 + *4> 3 ; > 0. 


Example P 4_8 (4 variables, degree 8): 

/ = X3X2 + XgX® — X4X2 + Xgxl + X3X4 — X3X4; 91 = Xg + x| + X3 + x|; 

92 = 3 xg + 2x2 — 4x1X2 + 3x3 + 2 x| — 4x3x4; 93 = Xg + 6x| — 8x1x2 + Xg + 6x4 — 8x3x4 + 2 . 5 ; 

94 = Xg + 3X2 + Xg + 3X4; 95 = Xg + Xj + Xg + X4; X > 0 . 

Example P 6_2 (6 variables, degree 2 ): 

/ = Xg — x| + Xg — x| + Xg — Xg + XI — X 2 ; 

91 = 2 xg + 3 x| + 2x1X2 + 2 x| + 3 x| + 2x3x4 + 2 xg + 3 xg + 2x5x5; 

92 = 3 xg + 2X2 — 4 xiX 2 + 3X3 + 2x| — 4x3x4 + 3 xg + 2xg — 4x5x5; 

93 = Xg + 6x| — 4x1X2 + Xg + 6x| — 4x3x4 + Xg + 6xg — 4x5x5; 

94 = Xg + 4 x| — 3x1X2 + Xg + 4 x| — 3x3x4 + Xg + 4 xg — 3x5x5; 

96 = 2 xg + 5x2 + 3 x 1 X 2 + 2x3 + 5 x| + 3x3x4 + 2 xg + 5 xg + 3x5x5; x > 0 . 


Example P 6_4 (6 variables, degree 4 ): 

/ = xf — x| + x| — x| + x| — x| + xi - X2; 

91 = 2 xf + X2 + 2x1X2 + 2x| + x| + 2x3x4 + 2x| + x^ + 2x5x5; 

92 = 3 xg + X2 — 4x1X2 + 3X3 + X4 — 4x3x4 + 3 xg + Xg — 4x5x5; 

93 = 3;j + 6x| — 4x1X2 + Xg + 6x| — 4x3x4 + Xg + 6xg — 4x5x5; 

94 = Xg + 3 x| — 3 X 1 X 2 + Xg + 3X4 — 3X3X4 + Xg + 3 Xg — 3x5x5; 

95 = 2 Xg + 5X2 + 3 X 1 X 2 + 2 Xg + 5X4 + 3x3x4 + 2 Xg + 5 Xg + 3X5X6, X > 0 . 


Example P6_6 (6 variables, degree 6): 

/ = Xg — X® + Xg — X® + Xg — Xg + Xl — X2; 

91 = 2 Xg + SXg + 2 X 1 X 2 + 2X3 + 3 x| + 2X3X4 + 2 Xg + 3 Xg + 2x5x5; 

92 = 3 xg + 2X2 — 4x1X2 + 3X3 + 2x| — 4x3x4 + 3 xg + 2xg — 4x5x5; 

93 = Xg + 6x| — 4x1X2 + Xg + 6x| — 4x3x4 + Xg + 6xg — 4x5x5; 

94 = Xg + 4 x| — 3 X 1 X 2 + Xg + 4 x| — 3X3X4 + Xg + 4 x| — 3x5x5; 

95 = 2 xg + 5X2 + 3 x 1 X 2 + 2X3 + 5 x| + 3x3x4 + 2 xg + 5 xg + 3x5x5, x > 0 . 


Example P6_8 (6 variables, degree 8): 

/ = xf — x| + x| — x| + x| — x| + XI - X 2 ; 

91 = 2 xg + Sxg + 2x1X2 + 2x3 + 3 x| + 2x3x4 + 2 xg + 3 xg + 2x5x5; 

92 = 3 xg + 2x2 — 4x1X2 + 3x3 + 2x| — 4x3x4 + 3 xg + 2xg — 4x5x5; 

93 = Xg + 6x| — 4x1X2 + Xg + 6x| — 4x3x4 + Xg + 6xg — 4x5x5; 

94 = Xg + 4 x| — 3 X 1 X 2 + Xg + 4 x| — 3X3X4 + Xg + 4 x| — 3x5x5; 

95 = 2xj + 5 X 2 + 3x1X2 + 2xg + 5 X 4 + 3 x 3 x 4 + 2 xg + 5xg + 3 x 5 x 5 , x > 0 . 
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Example P8_2 (8 variables, degree 2): 

f = xf — X 2 + Xg — — Xg + Xy — Xg + xi — X 2 ; 

gi = 2xf + 3 X 2 + 2 x 1 X 2 + 2xg + 3x^ + 2 x 3 x 4 + 2 x| + 3xg + 2 x 5 X 6 + 2 xy + 3xg + 2 x 7 x 3 ; 

32 = 3xf + 2x| — 4 x 1 X 2 + 3 X 3 + 2x| — 4 x 3 x 4 + 3x| + 2xg — 4 x 5 X 6 + 3xy + 2xg — 4 x 7 x 3 ; 

93 = Xi + 6 x 2 — 4x1X2 + X 3 + 6 x| — 4 x 3 x 4 + Xg + 6 xg — 4x5X6 + Xy + 6 xg — 4 x 7 x 3 ; 

34 = X 3 + 4 x 2 — 3 x 1 X 2 + X 3 + 4x| — 3 x 3 x 4 + Xg + 4xg — 3 x 5 X 6 + Xy + 4xg — 3 x 7 x 3 ; 

35 = 2 x 3 + 5x| + 3 x 1 X 2 + 2 x 3 + 5x| + 3 x 3 x 4 + 2xg + 5xg + 3 x 5 x 3 + 2xy + 5xg + 3 x 7 x 3 ; x > 0. 

Example P8_4 (8 variables, degree 4): 

/ = xf — x| + x| — x^ + x| — x| + x^ — x| + xi — X 2 ; 

31 = 2xf + 3x| + 2 x 1 X 2 + 2 x 3 + 3x| + 2 x 3 x 4 + 2xg + 3xg + 2 x 5 x 3 + 2xy + 3xg + 2 x 7 x 3 ; 

32 = 3 X 3 + 2x| — 4 x 1 X 2 + 3x| + 2x| — 4 x 3 x 4 + 3x| + 2xg — 4 x 5 x 3 + 3xy + 2x| — 4 x 7 x 3 ; 

33 = X 3 + 6 x 2 — 4 x 1 X 2 + X 3 + 6 x| — 4 x 3 x 4 + Xg + 6 xg — 4 x 5 X 6 + Xy + 6 xg — 4 x 7 x 3 ; 

34 = X 3 + 4 X 2 — 3 x 1 X 2 + X 3 + 4x| — 3 x 3 x 4 + Xg + 4xg — 3 x 5 X 6 + Xy + 4xg — 3 x 7 x 3 ; 

35 = 2 x 3 + 5x| + 3 x 1 X 2 + 2 x 3 + 5x| + 3 x 3 x 4 + 2xg + 5xg + 3 x 5 x 3 + 2xy + 5xg + 3 x 7 x 3 , x > 0. 

Example P 8_6 (8 variables, degree 6 ): 

/ = X® — x® + X 3 — x® + Xg — Xg + X® — Xg + XI — X 2 ; 

31 = 2x® + 3 x 2 + 2 x 1 X 2 + 2 x 3 + 3x| + 2 x 3 x 4 + 2xg + 3xg + 2 x 5 x 3 + 2x® + 3xg + 2 x 7 x 3 ; 

32 = 3 X 3 + 2 x| — 4 x 1 X 2 + 3 X 3 + 2 x| — 4 x 3 x 4 + 3xg + 2 xg — 4 x 5 x 3 + 3xy + 2 xg — 4 x 7 x 3 ; 

93 = xf + 6 x| — 4 x 1 X 2 + x| + 6 x| — 4 x 3 x 4 + x| + 6 xg — 4 x 5 x 3 + x| + 6 x| — 4 x 7 x 3 ; 

34 = X 3 + 4 x 2 “ 3 x 1 X 2 + X 3 + 4x® — 3 x 3 x 4 + Xg + 4xg — 3 x 5 x 3 + Xy + 4xg — 3 x 7 x 3 ; 

35 = 2 x 3 + 5x| + 3 x 1 X 2 + 2 x 3 + 5x| + 3 x 3 x 4 + 2xg + 5xg + 3 x 5 x 3 + 2xy + 5xg + 3 x 7 x 3 , x > 0. 

Example P10_2 (10 variables, degree 2): 

/ = xf — x^ + x| — x| + x| — x| + x^ — Xg + x| — xjg + XI — X 2 ; 

31 = 2 x 3 + 3x| + 2 x 1 X 2 + 2 x 3 + 3x| + 2 x 3 x 4 + 2xg + 3xg + 2 x 5 x 3 + 2xy + 3xg + 2 x 7 x 3 + 2xg + 3xfg + 2 x 9 x 10 ; 

32 = 3 x 3 + 2 x| — 4 x 1 X 2 + 3 x 3 + 2 x| — 4 x 3 x 4 + 3xg + 2 xg — 4 x 5 x 3 + 3xy + 2 xg — 4 x 7 Xg + 3xg + 2xfg — 4 x 9 x 10 ; 

93 = x:f + 6 x 2 — 4 x 1 X 2 + X 3 + 6 x| — 4 x 3 x 4 + Xg + 6 xg — 4 x 5 x 3 + Xy + 6 xg — 4 x 7 Xg + Xg + Gx^q — 4 x 9 x 10 ; 

34 = Xj + 4 x 2 ~ 3 x 1 X 2 + X 3 + 4x| — 3 x 3 x 4 + Xg + 4xg — 3 x 5 x 3 + x^ + 4xg — 8 x 7 x 3 + Xg + 4 x ^0 — 8 x 9 x 10 ; 

35 = 2 x 3 + 5x| + 3 x 1 X 2 + 2 x 3 + 5x| + 3 x 3 x 4 + 2 x 5 + 5xg + 8 x 5 x 3 + 2xy + 5xg + 8 x 7 x 3 + 2xg + Sxjg + 8 x 9 x 10 ; 

X > 0. 

Example P10_4 (10 variables, degree 4): 

/ = xf — x| + x| — x^ + x| — x| + x| — x| + x| — xfg + xi — X 2 ; 

31 = 2xf + 3x| + 2 x 1 X 2 + 2 x 3 + 3x| + 2 x 3 x 4 + 2xg + 3xg + 2 x 5 x 3 + 2xy + 3xg + 2 x 7 x 3 + 2xg + 3xfy + 2 x 9 x 10 ; 

32 = 3 x 3 + 2 x| — 4 x 1 X 2 + 3 x 3 + 2 x| — 4 x 3 x 4 + 3xg + 2 xg — 4 x 5 x 3 + 3xy + 2 xg — 4 x 7 x 3 + 3xg + 2 x ^0 — 4 x 9 x 10 ; 

93 = -t- 6 X 2 — 4 x 1 X 2 + X 3 + 6 x| — 4 x 3 x 4 + Xg + 6 xg — 4 x 5 x 3 + Xy + 6 xg — 4 x 7 x 3 + Xg + 6 X 30 — 4 x 9 x 10 ; 

34 = Xj + 4x| — 3 x 1 X 2 + X 3 + 4x| — 3 x 3 x 4 + Xg + 4xg — 8 x 5 x 3 + Xy + 4xg — 8 x 7 x 3 + Xg + 4 x ^0 — 8 x 9 x 10 ; 

35 = 2 x 3 + 5x| + 3 x 1 X 2 + 2 x 3 + 5x| + 3 x 3 x 4 + 2xg + 5xg + 8 x 5 x 3 + 2xy + 5xg + 8 x 7 x 3 + 2xg + Sx^g + 8 x 9 x 10 ; 
X > 0. 
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Example P20_2 (20 variables, degree 2): 


/ 

91 


92 


93 


94 


95 

x > 0. 


X 2 I I I 'Y*2 <7^2 1 /Y»2 1 'Y»2 I _ 'T'rt 

^ *^3 ^^4 5 ^6 *^9 *^10 11 ^12 

+^13 - ^14 + ^15 - ^16 + ^17 - ^18 + ^19 “ ^20 ^ 

2xf + 3x| + 2 x 1 X 2 + 2 x 3 + 3 x 4 + 2 x 3 x 4 + 2 xg + 3xg + 2 x 5 x 3 + 2 xy + 3xg + 2 x 7 x 3 
+ 2 x| + Sxfg + 2 x 9 x 10 + 2 xf 4 + 3 x ^2 + 2 x 11 X 12 + 2 x ^3 + 3 x ^4 + 2 x 13 x 14 + 2 xfg + 3xfg 
+2X15X16 + 2 x ^,4 + 3x|g + 2X17X18 + 2 xfg + 3xfp + 2 x 20 x 20 ; 

3xj + 2x| — 4 x 1 X 2 + 3 X 3 + 2x| — 4 x 3 x 4 + 3x| + 2xg — 4 x 5 X 6 + 3x^ + 2xg — 4 x 7 X 8 
+3x| + 2x^„ — 4 x 9 x 10 + 3x|j + 2x^2 “ 4x11X12 + Sxjg + 2 x ^4 — 4 x 13 x 14 
+3x^5 + 2xjg - 4X15X16 + 3x^7 + 2xfg - 4xi8Xi8 + 3xfg + 2 x|q - 4 x 19 x 20 ; 

X 4 + 6 x| — 4x1X2 + Xg + 6 x| — 4 x 3 x 4 + Xg + 6 xg — 4 x 5 x 3 + Xy + 6 xg — 4 x 7 Xg 
+x| + Ox^g — 4 x 9 X 10 + xf 4 + 6 x ^2 “ 4 x 11 X 12 + xfg + 6 x ^4 — 4 x 13 x 14 
+xjg + 6 x ^7 - 4X16X16 + x^y + 6 x^g - 4X17X18 + xfg + 6 x|g - 4 x 19 x 20 ; 

X4 + 4X2 — 3 X 1 X 2 + Xg + 4 x| — 3X3X4 + Xg + 4 Xg — 3X5X6 + Xy + 4 Xg — 3X7X8 
+Xg + 4 xjg — 3x9x10 + Xj + 4X42 — 3 X 11 X 12 + X43 + 4X44 — 3 X 15 X 14 
+xfg + 4 xfg — 3 X 15 X 16 + x^y + 4 xfg — 3 X 17 X 18 + xfg + 4 x§q — 3x19x20; 

2xj + 5x| + 3 x 1 X 2 + 2 x 3 + 5 x 4 + 3 x 3 x 4 + 2xg + 5xg + 3 x 5 X 6 + 2xy + 5xg + 3 x 7 X 8 
+2x| + 5xfg + 3 x 9 x 10 + 2 x ^4 + 5x^3 + 3x12X12 + 2 x ^3 + 5 x ^4 + 3 x 13 x 14 

+ 2 x ^5 + 5xjg + 3x15X16 + 2 x ^7 + 5xfg + 3xi7Xi8 + 2xfg + 5 x|q + 3 x 19 x 20 ; 


Example P20_4 (20 variables, degree 4): Same as P20_2 except that / is replaced by 

/ = xf - x| + x| - x| + xf - x| + x^ - x| + x| - xfg + xfg - xf 2 

+^13 - ^14 + ^15 - ^16 + ®17 - ^18 + ^19 “ ^20 i 


Xi — X2 


5.1 Test functions for BSOS versus LP relaxations of Krivine-Stengle on 
convex problems in Table [2] 

Example C4_2 (4 variables, degree 2): 

f = xi X 2 x^ x^2x1X2 — XI — X2; 
g2 = —2x1 ~ ^2 ~ ^^3 ~ ^4 + 
g4 = —4x1 ~ ^2 ~ ^^3 ~ ^4 + 1-25; 


Example C4_4 (4 variables, degree 4): 

f = xf X 2 + x^ xf 3x1x2 — Xi — X2\ 
g 2 = —2xf — X 2 — 2x‘^ — 3 :| + 1 ; 
g4 = —4xf — X 2 — 4x^ — x'^-\- 1.25; 

Example C4_6 (4 variables, degree 6 ): 

f = xi 4-x^ 4- x^ + x^-\- ^xfx^ — XI — X2; 
g2 = —2x1 ~ ^2 ~ ^^3 “ ^4 + 

514 = —4x1 ~ ^2 ~ ^^3 ~ ^4 + 1.25; 

Example C6_2 (6 variables, degree 2): 

f = xi 4-x^ 4- x^ 4-x^4-x^ 4- x^ + 2xiX2 — xi - X2-, 

g2 = —2x1 ~ ^2 ~ ^^3 “ ^4 ~ 2^5 ~ ^6 

g4 = —4x1 ~ ^2 ~ ^^3 ~ ^^5 ~ ^6 1.25; 

Example C6_4 (6 variables, degree 4): 

f = xf 4- X 2 4- x'^ 4- x'^ 4- x'^ 4- Xq 4- — xi — X 2 ; 

g 2 = —2xf — X 2 — 2x^ — x^ — 2x| — 3::g + 1; 

g 4 = —4xf — X 2 — 4x^ — — 4xq — x^4- 1.25; 


gi = —xi — 2 X 2 — Xg — 2 X 4 + 1 ; 
gs = —x1 — 4x2 ~ ^3 ~ ^^4 + 1-25; 

= —2x^ — 3 x 2 — 2x3 — 3x4 + 1.1; X > 0. 


gi = —xf — 2 X 2 — X 3 — 2 X 4 + 1 ; 

gs = —xf — 4x2 ~ ^3 ~ ^^4 + 1.25; 

= —2xf — 3 X 2 — 2 X 3 — 3 x 4 + 1 . 1 ; X > 0 . 


gi = —xf — 2 X 2 — X 3 — 2 X 4 + 1 ; 

^3 = —xi — 4 X 2 — x| — 4 X 4 + 1.25; 

g^ = —2x1 ~ ^^2 ~ ^^3 ~ ^^4 X > 0. 


gi = —xi — 2 X 2 — X 3 — 2 X 4 — Xg — 2 xg + 1 ; 

513 = —xJ — 4X2 — X3 — 4X4 — Xg — 4 xg + 1 . 25 ; 

gs = — 2 x 1 ~ ^^2 “ ^^3 “ ^^4 ~ ^^5 ~ ^^6 X > 0 . 


gi = —xf — 2 X 2 — X 3 — 2 X 4 — Xg — 2 xg + 1 ; 
gs = —xf — 4 x 2 ~ ^3 ~ ~ ^5 ~ ^^6 1*25; 

55 = —2xf — 3x1 — 2xf — 3x| — 2xg — 3x| + 1.1; x > 0. 
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Example C 6_6 (6 variables, degree 6 ): 


f = xf + ^x\x 2 — x\ — X 2 ; gi = —xf — 2 x 2 ~ ^3 ~ ^^4 ~ ^5 ~ 2^6 

g 2 = —2xf — X 2 — 2x^ — x^ — 2x^ — Xq 1; gs = ~ 4^2 — x^ — 4x| — a;| — Ax‘q + 1.25; 

^4 = — 4 x^ — X2 — 4 x^ — 3^1 — 43^1 — Xq 1 . 25 ; 35 = — 23 :^ — 33 :| — 23 :^ — 33 :| — 23:5 — 33 ;^ + 1 . 1 ; 3: > 0 . 

Example C8_2 (8 variables, degree 2): 

f = xf X2 + x"^ x"^ x"^ Xq + Xq 2 X 1 X 2 — XI — X 2 \ 

g2 = —2x^ — X 2 — 2 X 3 — x| — 2 X 3 — Xg — 2 xy — Xg + 1 ; 

54 = — 4 x^ — X2 — 4X3 — x| — 4 xg — Xg — 4 xy — Xg + 1 . 25 ; 

X > 0. 

Example C8_4 (8 variables, degree 4): 

f = xf -\- X2 -\- x^ xf-\- x^ -\- Xq x^ -h Xg -\- 3x^X2 — XI — X2; gi = ~ ‘^X2 — Xg — 2 x| — Xg — 2 xg — x| — 2 xg + 1 ; 

g 2 = —2xf — X 2 — 2 X 3 — x| — 2xg — Xq — 2xj — Xg + 1; g 3 = ~ "^^2 ~ ^3 ~ ^^4 ~ ^5 ~ — x| — 4xg + 1.25; 

514 = —4xf — X 2 — 4 X 3 — x| — 4x| — Xg — 4x^ — Xg + 1.25; gs = —2xf — 3 x 3 — 2 X 3 — 3x| — 2x| — 3xg — 2x| — 3xg + 1.1; 

X > 0. 


gi = —xf — 2 X 2 — X 3 — 2 x| — Xg — 2 xg — Xy — 2 xg + 1 ; 

= —xf — 4 X 2 — X 3 — 4x| — Xg — 4xg — Xy — 4xg + 1.25; 

35 = —2x^ — 3 X 2 — 2 X 3 — 3x| — 2xg — 3xg — 2xy — 3xg + 1.1; 


Example C10_2 (10 variables, degree 2): 


/ 

91 

92 
92 , 

54 

93 

X > 0. 


xf + x^ + x| + x| + x| + x| + x^ + x| + x| + xfp + 2 X 1 X 2 — XI - X2; 
—x\ — 2X2 — X3 — 2 x\ — Xg — 2xg — Xj — 2xg — Xg — 2 x^q + 1; 

— 2 xj — X 2 — 2 X 3 — x\ — 2 xg — Xg — 2 x^ — Xg — 2 xg — xJq + 1 ; 

—x^ — 4 X 2 — X 3 — 4x^ — Xg — 4xg — Xy — 4xg — Xg — 4 x^q + 1.25; 

_ 4x^ _ ^2 _4x^_ ^4 _4x^_x^_4xy_x^_4x^_ ^1 4” ^ 25" 

—2xj — 3 X 2 — 2xg — 3x| — 2xg — 3xg — 2xj — 3xg — 2xg — 3 xJq + 1.1; 


Example C10_4 (10 variables, degree 4): 


/ 

91 

92 

93 

94 

95 

X > 0. 


= + x| + x| + + x| + x| + + x| + x| + xfg + 3 x Jx| — Xi — X2; 

— —X^ — 2X2 ~ ^3 ~ ^^4 ~ ^5 ~ ^^6 ~ ^7 ~ ^^8 ~ ^9 ~ ^^10 ^ 

— _9^4 _ ^4 _ 9„4 _ „4 _ 9„4 _ „4 _ 9,^4 _ „4 _ 9„4 _ ^,4 11. 

— 2 ^*^3 ^^4 ^3 ^^9 10 ^ 

= —x| — 4 x| — Xg — 4 x| — x| — 4 xg — xf — 4 x| — Xg — 4x10 + 1 . 25 ; 

= — 4 xj — x| — 4 xg — x| — 4 x| — Xg — 4 x| — x| — 4 xg — xfg + 1 . 25 ; 

= —2xf — 3x2 — 2xg — 3X4 — 2x1 — 3 xg — 2X7 — 3 xg — 2xg — 3 xjg + 1.1; 


Example C20_2 (20 variables, degree 2): 


f 

91 

92 

93 

94 

95 

X > 0. 


+^11 ^ 

= -^1 - 

-xfi - 
= -2xf 
— 2r^ 

zxii 

= -X?- 


—4xf - 

-4x2i 

- 2 xf - 

-2 x2i 


I + Xg + X| + Xg + Xg + x;f + xg + X| + X|q + 2X1X2 — Xl — X2 

1 - X^2 + ^13 + ^14 + ^15 + ^16 ^17 ^18 ^19 ^20’ 

i„2 _ ^2 _ 9„2 _ ^2 _ 9„2 _ ^2 _ 9„2 _ ^^2 _ 9„2 

#j>2 *^3 ^^4 ^^5 ^^0 ^j>g ^^10 

2 t^ — — 2 t^ — x^ — 2 t^ — x^ — 2 x^ — x^ — 2 r^ -I- 1 • 

zxi2 x^3 Xj^g -ix^g Xj^y ^*^18 *^19 -^*^20 ^ 

X2 — 2X3 — X4 — 2 Xg — Xg — 2X7 — Xg — 2 Xg — xfg 


_ 9^2 _ yy,2 _ 9^2 _ ^2 _ 9ry.2 _ ^2 _ 2x^ _ x^ -U 1 • 

^ x-jo X -,4 -^16 "^'^17 *^18 ^*^19 -^20 4 ^ 


-Xf 

^x^ _x^_4x^_x^_4x^_x^_4x^_x^_4x^ 

- 4x^2 ~ *13 ~ ^*14 ~ *15 ~ ^*16 ~ *17 ~ ^*18 ~ *19 ~ ^*20 + 1-25; 

- x| — 4 Xg — x| — 4 Xg — Xg — 4 Xy — Xg — 4 Xg — Xgg 

- x ^2 “ 4xjg — x ^4 — 4xgg — Xgg — 4xj.^ — x^g — 4xjg — x^Q + 1.25; 

- 3x2 — 2X3 — 3 x| — 2 x| — 3 xg — 2 xy — 3 xg — 2 xg — 3 x^q 

- 3xg2 — 2x^3 — 3xf^ — 2x^5 — 3x^g — 2xf.^ — 3x^g — 2xgg — 3x|g + 1.1; 
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